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USE^ ON-SCREEN DISPLAY (OSD) FOR^SUPPLYING 
CONTROL AND AUXILIARY INFORMATION TO EXTERNAL DEVICES 



CROSS-REFERENCE TO RELATED APPLICATIONS 

5 This is a non-provisional patent application based on co-pending 

provisional patent application serial number 60/093,699 filed July 22, 1998. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to digital video signal processing and, nnore 
10 particularly, to a scheme for providing control information in a digital data 
stream. 

2. Description of the Related Art 

In analog television systems, certain auxiliary information such as closed 
captioning, exterfded data service (XDS), vertical interval test signal (VITS), and 
15 the like, is included in an analog signal in the form of data inserted into the 

vertical blanking interval (VBI). In digital television or multi-media systems, the 
traditional analog vertical and horizontal blanking areas or intervals and the 
information contained in those areas may not be transmitted as part of the 
picture information. 

20 in the digital domain, auxiliary information such as that found in the 

blanking portions of an analog signal is typically transmitted and processed 
independently of the received video information. For example, a digital television 
signal or direct broadcast satellite (DBS) signal such as that provided by 
DirecTV™, provides a stream of digital data arranged in "packets", thus the term 

25 packetized data. The packetized data is received and processed by a digital 
signal receiver. Some packets provide video information, other packets provide 
audio information, and still other packets provide control and/or auxiliary 
information such as closed caption data. Additional information contained in 
each packet identifies the type of data included in each packet. The receiver 

30 processes the packets and generates video, audio, and auxiliary information 
signals. 
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The analog output signal may be provided in any format such as NTSC, 
PAL or other standard, and is produced by converting the digital signal to an 
analog signal and processing the analog signal in an encoder {NTSC, PAL, etc.) 
circuit. In the United States, the digital signal is converted into an NTSC 
5 standard analog signal and will be referred to hereafter as such with the 

understanding that such reference encompasses other types of encoded analog 
signals. The digital signal can also be output as an RGB {red, green, blue) signal 
or component Y, Pr, Pb or Y, Cr, Cb signals. 

As the NTSC analog output signal is generated by the NTSC encoder 
10 circuit, vertical and horizontal blanking regions are produced in the signal. If 
required, auxiliary information received as packetized data in the digital signal 
may be inserted in the appropriate portions of the analog signal. For example, 
closed caption {CO information is inserted Into line 21 of field 1, as implemented 
in the U.S. NTSC system. The resulting NTSC signal may then be coupled to a 
15 conventional analog television (video) signal receiver and the closed captioning 
information may be decoded using a conventional closed caption decoder 
included in the analog television signal receiver. However, depending on the 
capabilities of the broadcast network and the digital receiver/decoder, it may not 
be possible to include some or any of the auxiliary information in the blanking 
20 intervals generated by the digital receiver. In addition, a video receiver having an 
RGB component or similar output may not have blanking intervals and as a result 
cannot include auxiliary information in the conventional manner. 

In addition to CC, XDS, and other auxiliary information delivered in the 
blanking intervals of an analog video (television) signals, the analog video signals 
25 may also include control information such as what is known as the Copy Guard 
Management System (CGMS). CGMS has been developed to permit receiving 
devices to control the recording and copying of programming. The CGMS 
scheme provides two bits that are included in a program signal to indicate one of 
four different record/copy modes that is permitted for the program. For example, 
30 one mode prohibits copying. Another mode permits one copy to be made. 
Another mode permits unlimited copying. In analog television signals, the 
required copy control information can be provided to the receiver in the vertical 
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blanking Interval. Other coding/data/information delivery schemes may also 
utilize blanking intervals. In receivers receiving digital signals or analog signals 
without blanking intervals or in systems lacking encoders capable of inserting the 
information in generated blanking intervals, providing required control information 

5 such as copy control information that can be detected and processed by other 
devices becomes problematic. Even if the signal includes blanking intervals, 
including additional control information such as copy control information may be 
difficult or impossible for systems that require adding a significant amount of 
control data to the already substantial amount of data that may already be 

10 included in blanking intervals. 

Most current video or television reception devices, whether analog or 
digital, now include on-screen display (OSD) capability for generating messages 
that appear in the displayed video image and convey information, such as 
channel number, time, and the like to a user. The typical OSD generator can 

15 manipulate the color and/or palette of each pixel as well as control whether the 
pixel is on or off. A typical OSD also includes a microprocessor generating 
desired graphics or character display information, e.g. the microprocessor 
accesses a character generator ROM, and inserting the display information into 
the output signal at the appropriate time to produce the OSD display in the 

20 desired region of the display. To insert the OSD information at the correct time, 
the systems can use the video synchronization signals to track the current 
display location by determining the pixels per line (horizontal display position) and 
line intervals (vertical display position). When the line count and pixel count 
indicate that the display has reached a location where OSD information is to be 

25 inserted, the microprocessor controls a fast switch to couple the OSD 
information to the output signal. 

What is needed in the art is a way for providing control and auxiliary 
information in systems producing signals lacking blanking intervals. 

As well, what is needed in the art is a way for providing control and 

30 auxiliary information in systems unable to include such information in blanking 
intervals. 
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SUMMARY OF THE INVENTION 

The problem described above of providing control and/or auxiliary 
information in systems producing signals lacking blanking intervals or in systems 
unable to include control and/or auxiliary information in blanking intervals, is 
overcome with the present invention by using a resident OSD feature to insert 
control or other information such as signatures or watermarks during non- 
blanking portions of the signal, e.g. active display intervals. 

An OSD system can be controlled e.g. via software, to insert information 
at any location in the display region through the video signal. Thus, the OSD 
system can be utilized to mirror or deliver the control and/or auxiliary information 
usually included in the blanking interval of an analog television signal into the 
non-blanking portions of the signal. As an example, for signals outputted as an 
RGB signal, the OSD by manipulating the pixels would insert a visual depiction of 
the data representing the desired control or auxiliary information during portions 
of the output signal corresponding to the desired non-blanking portion of the 
signal. Then, a device external to the device providing the OSD capability, e.g. a 
video display device coupled to the output of a digital receiver, a VCR, or other 
recording/playback device coupled to the output of a digital receiver, will receive 
the data representing the desired information in the non-blanking region and 
process the data to obtain the required control and/or auxiliary information. The 
obtained information may be acted upon or otherwise by the external device. 

For certain systems, the OSD could repeat auxiliary or control information 
in the non-blanking regions to provide for decoding by systems in which 
decoding of information within the blanking area is not practical or desired. In 
other systems, the OSD could generate or duplicate the information typically 
found in blanking areas into non-blanked areas in a similar format. In addition, 
the chroma and luminance capabilities of the OSD can be utilized to further 
expand the data handling capabilities since the OSD is capable of determining the 
characteristics of individual pixels. 

The information inserted by the OSD in the non-blanking regions may be 
inserted in a manner that will not produce an objectionable display. For example, 
the OSD can insert the information during an active display region that is in an 
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overscan region. If the amount of information is extremely limited or static, e.g. 
two bits of copy control information {CGMS}, such auxiliary or control 
information could be inserted in the visible display region without causing 
objectionable display artifacts. 

5 In accordance with an aspect of the present invention, a video receiver's 

built-in OSD can be utilized to generate or emulate control and/or auxiliary 
information of any other data or information traditionally delivered along with the 
video information in the blanking areas in a similar format in the non-blanked 
portions of the video signal for decoding by external devices when decoding of 

10 information within the blanking areas is not possible, practical or desired. Such 
can be implemented in software to control the OSD, 

The information can be duplicated in the non-blanking portions of the video 
for decoding by external devices when decoding of Information within the 
blanking areas is not practical or desired. 

15 BRIEF DESCRIPTION OF THE DRAWINGS 

The above-mentioned and other features and advantages of this invention, 
and the manner of attaining them, will become more apparent and the invention 
will be better understood by reference to the following description of an 
embodiment of the invention taken in conjunction with the accompanying 

20 drawings, wherein: 

Fig, 1 is a block diagram of a digital video receiver in accordance with the 
principles of the present invention; and 

Fig. 2 is a block diagram of an external device or module couplable to the 
output of the digital video receiver of Fig. 1 in accordance with the principles of 

25 the present invention. 

Corresponding reference characters indicate corresponding parts 
throughout the several views. The exemplification set out herein illustrates a 
preferred embodiment of the invention, and such exemplification is not to be 
construed as limiting the scope of the invention in any manner. 

30 DETAILED DESCRIPTION OF THE INVENTION 

Referring now to the drawings and, more particularly to Fig. 1, there is 
shown a simplified, functional block diagram of a video receiver generally 
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designated 10 in accordance with the principles of the present invention. 
Receiver 1 0 can be any type of video signal receiver such as a DBS receiver, a 
converter/set-top box or the like that is adapted to receive via input 12a radio 
frequency (RF) digital signal. The source{s) of input signal may be via satellite, 

5 cable system, over-the-air, or otherwise and may or may not contain control 
information, signature information, XDS, CC, or the like. 

Receiver 10 has RF tuner/demodulator/link 16 that receives the digital 
signal via input 1 2 and which contains circuitry for such reception as well as for 
the selection of an input signal or channel from the incoming digital signal, digital 

10 demodulation of the signal. Forward Error Correction (FEC) decoding, and the 
outputting of the decoded data. Tuner/demodulator/link 16 is in communication 
with transport portion 1 8 that provides a first level of decoding of the error 
corrected data received from tuner/demodulator 1 6. Essentially, such first level 
decoding comprises routing the received data/information to the appropriate 

15 destination device within receiver 10 for further processing, e.g. audio 

data/information to the audio decoder, and video data/information to the video 
decoder and so forth. In the case of video, transport 18 forwards the video 
information to video decoder 22, typically an MPEG video decoder. MPEG video 
decoder 22 is a real-time video decompression processor that decodes and 

20 processes the MPEG compressed data. MPEG video decoder 22 is in 

communication with microprocessor or controller 20 and any internal or external 
memory (not shown) as may be necessary to provide the necessary decoding and 
processing functions. Also, microprocessor 20 is in communication with RAM 
and/or ROM. Microprocessor 20 is coupled to the other shown modules or 

25 devices within receiver 1 0 as well as those not shown via link 28 as necessary 
to receive and process the incoming audio and video signals. 

As shown in Fig* 1, MPEG video decoder 22 includes an integral OSD 
generator 24, however, it should be understood that the OSD generator may be 
separate from the MPEG video decoder. OSD generator 24 provides bit-map 

30 capabilities to manipulate color and palette of each pixel, as well as whether the 
pixel is on or off, for overlaying same on any portion of the display, including 
blanking, while video decoding proceeds simultaneously. Palette registers may 
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be selected and loaded with any color or with a value to indicate transparent 
pixels. 

In accordance with an aspect of the present invention, microprocessor 20 
supplies appropriate control, data, signature, and similar information (collectively 

5 control information) as is desired per appropriate software to OSD 24 for 

inclusion as OSD data/information into the video signal. Any data/information 
received by receiver 10, such as CGMS information, may be inserted into the 
video signal as an OSD signal during non-blanking intervals. Data or information 
not received by receiver 10 through non-inclusion of same in the incoming signal 

10 or unable to be processed by receiver 10, may be inserted into the video signal 
as internally generated (emulated) OSD data/information. Of course, any 
data/information delivered as an OSD signal will be displayed on the display 
device (external device). However, while such information may be displayed, it 
may not necessarily be viewable if such information is in an overscan area, or 

15 contained in various individual pixels throughout a display portion or the entire 
display area which would not be readily discerned by the eye. 

MPEG video decoder 22 is in communication with video digital to analog 
(D/A) converter 26 that converts the digital video signal, with or without OSD 
data/information including OSD coded data/information in accordance with the 

20 present principles, into an analog video signal without synchronization signals. 
Synchronization signals are generated within receiver 10 and outputted as a 
separate signal from the video signal. Video D/A converter 26 contains three 
digital-to-anaiog converters to convert the Y, Cr, and Cb video data signals from 
MPEG video decoder 22 into Y, Pr, and Pb video signals. If necessary, the Y, Pr, 

25 and Pb signals may be matrixed as is known in the art to provide an RGB (video) 
output signal. In this case, the video signals would also include any OSD 
data/information- Video D/A converter 26 has output 14 that provides the 
analog video representation of the digital video information received by receiver 
10 and any OSD data/information including any coded, emulated, or imbedded 

30 data/information . 

Thus, the OSD of a video receiver is utilized to transmit data or 
information to an external device that separately processes the OSD data or 
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information during real-tinne video processing which can then be used by the 
external device for device control or otherwise. This is accomplished, at least in 
part, by appropriate software for the video receiver. 

With reference now to Fig. 2, there is shown externa! device or module 30 

5 that can be incorporated into a VCR or other recording/playback device, 
television/monitor, or the like that receives and utilizes video signals and of 
course, is separate from receiver 10. External device 30 includes video input 32 
that feeds into detector 38. In this case, detector 38 is adapted to receive the 
Y, Pr, and Pb or RGB video signals and provide output signals that correspond to 

10 the chroma and luminance values of each pixel, in essence processing the video 
signals including the OSD data/information included with those signals. As well, 
external device 30 includes sync input 34 which is provided by receiver 1 0 as a 
separate signal. Video synchronization signals are used for determining the 
location of pixels' on the video signal. Counter and/or timing circuits 40 are 

15 utilized to identify any position on the display (or bit-mapped area constituting 
what would be a display) to which a characteristic or value has been assigned, 
such as palette, color, on/off, or the like. Thus, any individual pixel, line of 
pixels, group of pixels, pattern of pixels, or the like may be identified by its 
characteristics as given to it by OSD 24 of receiver 10. Microprocessor 44, 

20 typically in communication with RAM and ROM, may be in communication with 
detector 38 and counter/timer 40 and under direction of appropriate software to 
ascertain, understand, and process the code, data, or information contained in 
the OSD data/information and/or to add intelligence to the processing. 
Detector 38, microprocessor 44, and counter/timer 40 are in 

25 communication with output gate 42 that provides gating of the detector output 
signal (e.g. the chroma and luminance value present at a location or group of 
locations) with the counter/timer output as appropriate to supply a signal to 
output 36, typically a logic or voltage level signal. The output signals which 
correspond to the OSD data/information can then be utilized for any purpose. 

30 One purpose may be to display a watermark or message that may be pre-stored, 
for example, in the ROM of a VCR or video display device that incorporates 
external device 30, or through controlling the characteristics of various pixels at 
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some point or points during the video. Another purpose may be to use the signal 
as a means of control of yet another device or scheme that could, for example, 
limit or prohibit the copying, recording, or other function of the other device. As 
well, broadcasters at the signal source may insert data/information into the non 
5 blanked portions of the video signal that can be detected and utilized by the 
present invention. 

White this invention has been described as having a preferred design, the 
present invention can be further modified within the spirit and scope of this 
disclosure. This application is therefore intended to cover any variations, uses, 
10 of adaptations of the invention using its general principles. Further, this 

application is intended to cover such departures from the present disclosure as 
come within known or customary practice in the art to which this invention 
pertains and which fall within the limits of the appended claims. 
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WHAT IS CLAIMED IS: 

1 . A method of communicating non-video data from a video [ 
receiver to an external device, the video receiver adapted to receive a digital 
video signal and output an analog video signal derived from the digital video 
signal; the method comprising: 

providing the non-video data to an OSD generator of the video 
receiver; ! 
formatting the non-video data as OSD data; \ 
inserting the OSD data into the analog video signal; 
providing the external device with an OSD data detector; 
detecting the OSD data to receive the non-video data. ^ ' 

i! 

2. The method of claim 1, wherein the OSD data is inserted into, 
the analog video signal during non-blanking portions. i 

3. The method of claim 1, wherein the non-video data is control; 

data. 

4. The method of claim 1 , wherein the non-video data is 
information usually included in a blanking interval of an analog video signal. 

. 5. The method of claim 1, wherein the non-video is contained in 
the digital video signal. : 

^ 

6. The method of claim 1, wherein the non-video data is i 
determined by the video receiver. ! 

7. The method of claim 1, wherein the OSD data is displayable in 
an overscan region. i 

8. The method of claim 1 , wherein the video receiver provides a^ 
sync signal to the external device. 



wo 00/05881 



1/1 



?^9. /T43 9 97 

PCT/US99/16187 



12 

V 

INPUT 



22 
24' 

20 



TUNER 
DEMODULATOR 
LINK 



MPEG VIDEO 
DECODER 



OSD 



CONTROL mP 



16 



TRANSPORT 



VIDEO D/A 



18 



28 



26 



RECEIVER 



FIG.1 



14 



. VIDEO 
OUTPUT 



10 



32 

VIDEO 
INPUT 



34 



SYNC 
INPUT 



44- 



DETECTOR 



MP 



COUNTER 
AND/OR 
TIMING CKTS 



38 



■42 



OUPUT 
GATE 



OUTPUT 
^36 



40 



EXTERNAL DEVICE 



30 



FIG. 2 



SUBSTrrUTE SHEET (RULE 26) 



Please type a plus sign (+) inside this box 



PTO/SB/01 (10-00) 
Approved for use through 10/31/2002. OMB 0651-0032 
Patent and Trademark Office" U.S DEPARTMENT OF COMMERCE 
Under the Paperwork Reduction Act of 1 995, no persons are required to respond to a collection of information unless it contains a valid OMB control number. 



/ 

DECLARATION FOR UTILITY OR 
DESIGN 
PATENT APPLICATION 
(37CFR1.63) 



I I Declaration 
Submitted OR 
with Initial 
Filing 



Declaration 
Submitted after 
Initial 

Filing (surcharge 
(37 CFR 1.16(e)) 



Attorney Docket Number 



First Named Inventor 



RCA 89130 



William Henry Mengel 



COMPLETE IF KNOWN 



Application Number 



Filing Date 



Group Art Unit 



Examiner Name 



/ 



As a below named inventor, 1 hereby declare that: 

My residence, mailing address, and citizenship are as stated below next to my name. 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint inventor {if plural 
names are listed below) of the subject matter which is claimed and for which a patent is sought on the invention entitled: 



USE OF ON-SCREEN DISPLAY (OSD) FOR SUPPLYING CONTROL AND AUXILIARY INFORMATION 
TO EXTERNAL DEVICES 



the specification of which 

1— 1 is attached hereto 
OR 

W was filed on (MM/DDATYY) 



(Title of the Invention) 



July 15, 1999 



as United States Application Number or PCT International 



Application Number | PCT/US99/16187 | and was amended on (MM/DDATYY) | AprU IS, 2000 | (if applicable). 

1 hereby state that t have reviewed and understand the contents of the above identified specification, Including the claims, as 
amended by any amendment specifically referred to above: 

I acknowledge the duty to disclose information which is material to patentability as defined in 37 CFR 1.56, including for 
continuation-in-part applications, material Information which became available between the filing date of the prior application and the 
national or PCT international filing date of the continuation-in-part application. 



1 hereby claim foreign priority benefits under 35 U.S.C. 119{a)-(d) or 365(b) of any foreign application(s) for patent or inventor's 
certificate or 365(a) of any PCT International application which designated at least one country other than the United States of America^ 
listed below and have also identified below, by checking the box, any foreign application for patent or inventor's certificate, or any PCT 
Internationa! application having a filing date before that of the application on which priority Is claimed. 



Prior Foreign 



Foreign Filing Date 



Priority 



Certified Copy Attached? 
YES NO 



□ 
□ 
□ 



a 
□ 
□ 
□ 



□ 
□ 
□ 
□ 



D Additional foreign application numbers are listed on a supplemental priority data sheet PTQ/SB/02B attached hereto: 
I hereby claim the benefit under 35 U.S.C. 1 19(e) of any United States provisional application(s) listed below. 



Application Number(s) 



60/093,699 



Filing Date (MM/PD/YYYY) 



July 22, 1998 



I I Additional provisional application 
numbers are listed on a 
supplemental priority data sheet 
PTO/SB/02B attached hereto. 



[Page 1 of 2] 

Burden Hour Statement: This form is estimated to take 21 minutes to complete. Time will vary depending upon the needs of the 
individual case. Any comments on the amount of time you are required to compiete this fonn should be sent to the Chief Information 
Officer, U.S. Patent and Trademark Office, Washington. DC 20231. DO NOT SEND FEES OR COMPLETED FORMS TO THIS 
ADDRESS. SEND TO: Assistant Commissioner for Patents, Washington, DC 20231. 



Please type a plus sign {+) inside this box 
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DECLARATION — Utility or Design Patent Application 



Direct all correspondence to: 



I I Customer Number 
' — ' or Bar Code Label 



OR 



Correspondence address below 



Name JOSEPH S. TRIPOLI ■ PATENT OPERATIONS 



Address THOMSON multimedia Licensing Inc. 



City PRINCETON 


State NJ 


ZIP Jg8540 


Country US 


Telephone 609-734-9517 


Fax 1-609-734-9700 



Address PO Box 5312 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and 
belief are believed to be tme; and further that these statements were made with the knowledge that willful false statements and the 
like so made are punishable by fine or imprisonment, or both, under 18 U.S.C. 1001 and that such willful false statements may 
jeopardize the validity of the application or any patent issued thereon. ^ 



NAME OF SOLE OR FIRST INVENTOR 



□ A petition has been filed for this unsigned inventor 



Given Name 

(first and middle [if any]) 



WILLIAM HENRY 



Family Name 
or Surname 



MENGEL 



Inventor's 
Signature 



/ 7^ 



Date 













Residence: City 


CARMEL 


State IN 


Country US 


Citizenship US 



Mailing Address 846 West 146th Street 



Mailing Address 



City Carmel 


State IN 


ZIP 46032 


Country US 


NAME OF SECOND INVENTOR: 


□ A petition has been filed for this unsigned inventor 


Given Name 

(first and middle [if any]) 


Family Name 
or Surname 



inventor's 
Signature 



Date 



Residence: City 



State 



Country 



Citizenship 



Mailing Address 



Mailing Address 



City 


state 


ZIP 


Country 


n Additional inventors are beina named on 


supplemental Additional lnventor(s) sheet(s) PTO/SB/02A attached hereto. 
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